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ABSTRACT. For a set-valued map, we characterize, in terms of its (unconvexified or con- 
vexified) graphical derivatives near the point of interest, positively homogeneous maps that 
are generalized derivatives in the sense of [17]. This result generalizes the Aubin criterion 
in (8). A second characterization of these generalized derivatives is easier to check in prac- 
tice, especially in the finite dimensional case. Finally, the third characterization in terms 
of limiting normal cones and coderivatives generalizes the Mordukhovich criterion in the 
finite dimensional case. The convexified coderivative has a bijective relationship with the 
set of possible generalized derivatives. We conclude by using the above results to describe 
the generalized differentiability properties of constraint systems, which includes the case 
of mixed equalities and inequalities satisfying the Mangasarian-Fromovitz constraint qual- 
ification as a particular example. 



We say that S is a set-valued map or a multifunction, denoted by S : X =t Y, if S(x) C Y 
for all i£X. There are many examples of set-valued maps in optimization and related 
areas. For example, the generalized derivatives of a nonsmooth function, the feasible set of 
a parametric optimization problem, and the set of optimizers to a parametric optimization 
problem may be profitably viewed as set- valued maps. 

The Lipschitz analysis of a set-valued map is equivalent to the metric regularity of its 
inverse. There are now many examples of how such a Lipschitz analysis can be used to 
derive stability conditions for problems in nonsmooth optimization, feasibility and equilib- 
rium. Such a Lipschitz analysis can identify when a problem is ill conditioned and cannot 
be easily resolved by any numerical method, explaining the presence of different types of 
constraint qualification conditions in numerical algorithms. The tools for such Lipschitz 
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1. Introduction 
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analysis usually involve the Mordukhovich criterion or the Aubin criterion, which we will 
discuss later in more detail. 

As an example, consider the problem P(u, v) defined by 

P(u,v) : inf v T x, (1.1) 

xes(u) 

where S : U =4 X is a set-valued map. A profitable way of analyzing P(u,v) is by studying 
the set-valued map S. The Lipschitz continuity of P(-,v) is established if S satisfies a local 
Lipschitz property, which can be easily checked when S has a closed convex graph through 
the Robinson-Ursescu Theorem. See for example EH5). 

It is natural to ask whether a first order analysis of set-valued maps can be effective 
for the first order analysis of these problems, but we need to first build the basic tools. 
This paper studies how a first order analysis of set-valued maps may be obtained from the 
geometrical properties of its graph, generalizing the Aubin and Mordukhovich criterions. 
We will apply our results to study the set-valued map of feasible points satisfying a set of 
equalities and inequalities in Proposition ^. II 

The Aubin criterion as presented in J8J characterizes the Lipschitz properties of a set- 
valued map S : X =4 Y using the tangent cones of its graph gph(S). Here, the graph gph(S) 
is the set {(x,y) | y 6 S(x)} C X x Y. One contribution of this paper is to characterize the 
generalized derivatives, introduced in ifTTl . of the set- valued map S in terms of the tangent 
cones of its graph. It is usually easier to obtain information on the tangent cones of gph(5) 
rather than the generalized derivatives, so our result will play the role the Mordukhovich 
criterion and the Aubin criterion currently have in Lipschitz analysis. We now recall some 
standard definitions necessary to proceed. The ball with center x and radius e is denoted 
by M £ (jc), and Bj (0) is written simply as B. 

Definition 1.1. (Positive homogeneity) Let X and Y be linear spaces. A set-valued map 
H : X =4 Y is positively homogeneous if 

H(0) is a cone, and H(kw) = kH(w) for all k > and w EX. 

A positively homogeneous map is also called a process. The positively homogeneous 
map (H + 8) : X Y, where H : X ^ Y is positively homogeneous and 8 > is a real 
number, is defined by 

(H + 8)(w) :=H(w) + 8\\w\\M. 
Here is the definition of generalized differentiability of set-valued maps introduced in IfTTl . 

Definition 1.2. [ 17] (Generalized differentiability) Let X and Y be normed linear spaces. 
Let S : X Y be such that (x,y) 6 gph(S), and let H : X Y be positively homogeneous. 
The map S is pseudo strictly H-differentiable at (x,y) if for any 8 > 0, there are neighbor- 
hoods U§ of x and V§ of y such that 

S(x) nV 8 C S(x) + (H + 8){x-x) for all x,x E U 5 . 

If S is pseudo strictly //-differentiable for some H defined by H(w) = K"||w||B, where fc > 0, 
then S satisfies the Aubin property, also referred to as the pseudo-Lipschitz property. The 
graphical modulus is the infimum of all such K, and is denoted by lipS(x | y). 

We had used T : X =4 Y to denote the positively homogeneous map in [17], but we now 
use H to denote the positively homogeneous map instead. We reserve T to denote the 
tangent cone, defined as follows. 
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Definition 1.3. (Tangent cones) Let X be a normed linear space. A vector welis tangent 
to a set C C X at a point ieC, written w G 7c (x), if 

X; —X 

>• vw for some x/ — > x, x, € C, T; \ 0. 

The set Tq (x) is referred to as the tangent cone (also called the contingent cone) to C at x. 

We say that S : X =t F is locally closed at (x,y) G gph(S) if gph(5) nB e ((x,y)) is a 
closed set for some £ > 0. 

Definition 1.4. (Graphical derivative) Let X and F be normed linear spaces. For a set- 
valued map S : X ^ Y locally closed at (x,y) G gph(S), the graphical derivative, also 
known as the contingent derivative, is denoted by DS(x | y) : X =J F and defined by 

gph(DS(x | j?)) = 7g ph(s) (x,y). 

The convexified graphical derivative is denoted by 7)**S(x | y) and is defined by 

gph(Z)**S(xb))=clcoT gph(5) (x,);), 

i.e., the closed convex hull of T^ h rg\ (x,y). 

The study of the relationship between the graphical derivative and the graphical modulus 
can be traced back to the papers of Aubin and his co-authors [UEl, El Theorem 7.5.4] and 
(6] Theorem 5.4.3]. The main result in (SI characterizes lip 5 | y) in terms of the graphical 
derivatives, and was named the Aubin criterion to recognize the efforts of Aubin and his 
coauthors. Their result will be stated as Theorem 12.41 Their proof was motivated by the 
proof of (21 Theorem 3.2.4] due to Frankowska. Another paper of interest on the Aubin 
criterion is (3), where a proof of part of the result in [8 ] was obtained using viability theory. 

In Asplund spaces, a different characterization of lip5(x | y) can be obtained in terms 
of (limiting) coderivatives. Coderivatives are defined in terms of the (limiting) normals 
of gph(S) at (x,y), so this approach can be considered as the dual approach to the Aubin 
criterion. This characterization known as the Mordukhovich criterion in |[T8ll . We refer 
to (5] Q21 [161 [18 1 for more on the history of this result, where the contributions of Ioffe 
are also highlighted. The Mordukhovich criterion has been frequently applied to analyze 
many problems in nonsmooth optimization, feasibility and equilibria. Quoting [ 8 ] , we note 
that when X is any Banach space and F is finite dimensional, a necessary and sufficient for 
S : X =4 F to have the Aubin property is given in terms of the Ioffe approximate coderivative 
in [12]. We also show how our result generalizes the Mordukhovich criterion in the finite 
dimensional case, and that the convexified coderivative has a bijective relationship with the 
set of possible generalized derivatives. 

The original context of the Aubin criterion was metric regularity, while the original 
context of the Mordukhovich criterion was linear openness. Metric regularity gives a de- 
scription of solutions sets to nonsmooth problems, which is one of the themes of the recent 
books |9l|T3). Further references of metric regularity and linear openness are ifTTl [161 [T8l . 
The equivalence between the Aubin property, metric regularity and linear openness is well 
known. For readers interested in applying the results in this paper in the context of metric 
regularity or linear openness, we refer to IfTTl Section 7], where a similar equivalence for 
generalized differentiability of set-valued maps, generalized metric regularity, and gener- 
alized linear openness is obtained. 
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1.1. Contributions of this paper. We present three sets of theorems to characterize the 
generalized derivatives of a set-valued map using the tangent and normal cones. The first 
set of theorems are presented in Section[2] Theorem l2.2l extends the Aubin criterion in the 
sense of generalized derivatives in Definition ! 1.21 and has a simple proof. 

We present a second characterization of the generalized derivatives in Section [3] that is 
easier to check in practice. The proof of this set of theorems depend on the first characteri- 
zation in Section|2] More specifically, consider S : X =$ Y locally closed at (x,y) £ gph(5) 
and a positively homogeneous map H : X =4 Y. Consider also {G,}, G /, where G; :X =4 T 
are positively homogeneous and / is some index set. We impose further conditions so that 
S is pseudo strictly H-differentiable at (x,y) if and only if 

Gi(p) n [-H(-p)] ± for all i e I and p E X\{0}. 

These conditions are easier to check in the finite dimensional case, and the Clarke regular 
case leads to further simplifications. 

Finally, a third characterization is expressed in terms of the limiting normal cones for 
the finite dimensional case in Theorem l5.4l generalizing the Mordukhovich criterion. This 
characterization depends on the second characterization in Section [3] The convexified 
coderivative will be shown to have a bijective relationship with the set of possible general- 
ized derivatives in Theorem l5.8l 

We apply the results above in Proposition |6T| to study the generalized differentiability 
properties of constraint systems, which includes the case of mixed equalities and inequali- 
ties satisfying the Mangasarian-Fromovitz constraint qualification as a particular example. 

1.2. Preliminaries and notation. We recall other definitions in set- valued analysis needed 
for the rest of this paper. We say that S is closed-valued if S(x) is closed for all x G X, and 
the definitions for compact-valuedness and convex-valuedness are similar. For set-valued 
maps S\ : X Y and S2 : X Y, we use Si C S2 to denote Si (x) C S2M for all x G X, 
which also corresponds to gph(Si) C gph(52). 

The outer and inner norms of positively homogeneous maps will be needed later. 

Definition 1.5. (Outer and inner norms) The outer norm \\H\\ + and inner norm \\H\\~ of a 
positively homogeneous map H : X =$ Y are defined by 

\\H\\+ := sup sup || 2 || 

\\w\\<lz.eH(w) 

andpT|r := sup inf || z ||. 

|| m ,||< 1 zG//(iv) 

The positively homogeneous maps defined as fans and prefans in [10| will be used 
frequently in the rest of this paper, and we recall their definitions below. 

Definition 1.6. 1 10 1 (Fans and prefans) We say that H : W 1 =3 K m is a prefan if 

(1) H(p) is nonempty, convex and compact for all p g R", 

(2) H is positive homogeneous, and 

(3) is finite. 

If in addition, H(pi + pi) C H(pi) +H(p2) for all pi,p2 € K", then we say that H is a 
fan. 

Fans feature heavily in the nonsmooth analysis of single-valued maps in iflOl . The 
additional assumption needed for fans turns out to be restrictive for the first order analysis 
of set-valued maps, as illustrated in Example ll.7l below. We shall only study prefans in this 
paper. 
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Example 1.7. (Prefans over fans) Consider S:R=^IRandi7:IR=^K denned by 

S(x) := (-co,*] and H (x) := max{0,x}. 

The set-valued map S is pseudo strictly //-differentiable at (0, 0), as can be easily checked 
from definitions or by applying Corollary 1 3 . 6 1 later. But H is a prefan and not a fan. 

We recall one possible definition of inner semicontinuity. Note that this definition may 
not be standard when X and Y are infinite dimensional. 

Definition 1.8. (Inner and outer semicontinuity) For a closed- valued mapping S : C =4 Y 
and a point x £ C C X, S is inner semicontinuous (written as isc) with respect to C at x if 
for every p > and e > 0, there exists a neighborhood V of x such that 

S(x)npMcS(x) + eB for all x £ C n V. 

We say that S is ewfer semicontinuous (written osc) with respect to C at x if for every p > 
and e > 0, there exists a neighborhood V of I such that 

S(x)npMcS(x) + eM for all x £ C n V. 

We say that a set C C R" is Clarke regular at x € C if the tangent map Tq : C =4 R" 
is inner semicontinuous at jc. We shall only look at Clarke regularity of sets in finite di- 
mensions, in part because our definition of inner semicontinuity is nonstandard in infinite 
dimensions. We say that S is graphically regular at (x,y) £ gph(S) if gph(S) is Clarke 
regular at (x,y). 

We recall the definition of the outer limit of sets. For {xi]°° =l C X, x £ X and C C X, the 

notation Xi — > x means Xi £ C for all i and Xi — > x. 

c 

Definition 1.9. (Outer limits) Let Cel. For a set-valued map S : C =S Y, the outer limit 
of S at x £ C, is defined by 

limsup5'(x) := {y \ there exists xi — > x, y,- £ S(xi) s.t. y; — )• y}. 

x— H c 

c 

Lastly, for K C X, the negative polar cone of K is denoted by K°, and is defined by 
K° = {v | (v,jc> < for all x £ K}. 

2. A FIRST CHARACTERIZATION: GENERALIZING THE AUBIN CRITERION 

The main result of this section is Theorem l2.2l where we generalize the Aubin criterion. 
We also mention that Lemma l2~3l will be used for much of the paper later. 
We list assumptions that will be used often in the rest of the paper. 

Assumption 2.1. Let X and Y be normed linear spaces, and assume further that Y is 
complete ( i.e, Y is a Banach space). Let S :X F be locally closed at (x,y) £ gph(S), and 
let H : X =t Y be positively homogeneous. 

The following is our first characterization of the generalized derivatives of S. 

Theorem 2.2. (Generalized Aubin criterion) Suppose Assumption \2. H holds. Consider the 
statements: 

(1) S is pseudo strictly H-differentiable at (x,y). 

(2) For all 8 > 0, there are neighborhoods U ofx and V ofy such that 

DS(x\y)(p)n[-(H + 8)(-p)]^(d (2.1) 
for all (x,y) £ gph(S) n [U X V] and p £ X\{0}. 
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(2') For all 8 > 0, there are neighborhoods U of x and V ofy such that 

D**S{x | y){p) n [-(H+8)(-p)] + (2.2) 
for all (x,y) E gph(S) D [U X V] and p E X\{0}. 

We then have the following: 

(a) IfY is finite dimensional and H is compact-valued, then (1) implies (2). 

(b) If \\H\\ + < °° and H is convex-valued, then (2) implies (1). 

(c) If both X and Y are finite dimensional and H is a prefan, then ( 1 ), (2) and (2') are 
equivalent. 

We begin with the proof of Theorem l2.2f a). which is the simplest. 

Proof. [Theorem |2j2ja)] Suppose S is pseudo strictly T-differentiable at (x,y). Then for 
any 8 > 0, there are neighborhoods U of x and V of y such that if (x,y) E [U x V] (~l gph(S), 
/? G ^\{0} and f is small enough so that x + tp £ U, then 

S(x)nV <zS(x + tp) + (H+8)(-tp). (2.3) 

(This can be seen as a lower generalized differentiation property, which resembles the 
lower Lipschitz or Lipschitz lower semicontinuous property in |[T3"1 [141 .) Since y lies in the 
LHS of dZ3l . there exists somey(f) G S(x + tp) such thaty £y(t) + (H+S)(—tp). Then 

^e-(if + «)(-p). 

Let y be a cluster point of { y ^~ y } as f \ 0, which exists since Y is finite dimensional and 
-(H + 8) (-p) is compact. We have y G DS(x | y) (p), so Z)S(jc | y) (p) n [-(H + 8) (-/?)] ^ 
as needed. □ 

To prove Theorem l2.21 b). we need the following lemma. 

Lemma 2.3. (Estimates of generalized differentiability from tangent cones) Suppose As- 
sumption]^]} holds, and assume further that H is convex-valued and \\H\\ + < °° Let 
8 > 0. Suppose there are neighborhoods U of x G X and V ofy G Y such that whenever 
(x,y) G [U x V] ngph(S) and p G X\{0}, there are (p',q') such that 

{p',q') G 7g ph(s) (x,y), \\p - p'\\ < 8\\p\\ and q E -(H + 8)(-p). (2.4) 

Then provided £ > is such that < £ + 8 < 1, f/zere are neighborhoods U £ ofx and V £ of 
y such that x* , x° E U £ implies 

S(x*) n v £ c S(*°) + (h + 8 + e + [\\h\\ + + 8 + e] - g g £ £ ) - Jf°). 

Proof. Let t/ £ and V £ be neighborhoods of Jc and y respectively such that 

[jt*,jc ] + ((5 + £)||x*-x ||B C C/, (2.5a) 
x° + [(8 + £) + {8 + £) 2 }\\x*-x°\\M c C/, (2.5b) 

andy*+ i _^_ £ ||x*-x°||[||//|| + + g + £]B C V (2.5c) 

for all (x*,y*) E [U £ x V £ ] flgph(5) and x° E U £ . Here, [x* ,x°] is the line segment connect- 
ing x* and x° . Figure lXTl mav be helpful in understanding the steps of the proof. 
Step 1: There are (>',/) G gph(5) such that 

Wxf-x'W < (8 + £)\\x°-x*\\ 

and y'-y* E -(H + 8 + e)(x* -x°). 
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Step 1 


Step 2 


^ V • • * -X" 


x/ 


• • • • 

x/x°-x*) x ° 
% 2 (x°-x*) 



Figure 2.1. Steps 1 and 2 of the proof of Lemma 123 



To simplify notation, let p := jc° — x*. Let T be the supremum of all T G [0, 1] such that 
there exists (x',y') G gph(S) satisfying 



and 



y 



-**]-T/J||<(5 + £)T||p|| 

■y* G -T(H + 5 + e)(-/5). 



(2.6) 



Given (x,y) G [t/ x V] ngph(S) and a direction p G X\{0}, there are p' £X and q>' G 
— (H + 8)(—p) such that (p\q') G 7g P h(s) (^y)- By the definition of tangent cones, for any 
A G (0,e), there is some {xx,yx) G gP h (S) such mat IKfein) - < A, life ~ x l ~ 



rp'|| < Af||p|| and ||fe-;y]- 



and 



-f^'H < Af \\p\\ for some f > 0. We thus have 

\\(xx 1 yx)-{x,y)\\ < A, 
||fe-*]-f/J||<(5 + A)||tf||, 

y x -y£t[-{H+8){-p)+X\\p\n 

= -(H + 8 + X)(-tp). 



Taking (x,y) — (x*,y*) gives us t > 0. Let (jci,ji) G gph(S) and Ti G (0, 1] be such that 
( 12.6b holds for (x 1 ,y') = (xi,yi) and T = Ti. If X\ < 1, we can use the existence of some 
[p'lil'i) S gph(D5(Ii | yi)) and obtain the existence of (i 2 ,;y 2 ) G gph(S) and t 2 G (li, 1] 
such that 



and 



||fe-Xi]-(T 2 -Ti)p|| < (5 + £)(T 2 -Ti) 

h-h e -(T 2 -Ti)(H + 5 + e)(-p). 



The implication 



-Xi(H + 8 + e)(-p) 
-( X2 - Xl )(H + 8 + e)(-p) 
-T 2 (H + 8 + e)(-p). 



yi-y g 

andy 2 -yi G 
implies yi—y* G 

requires the convexity of (H + 8 + e)(— p). These conditions imply that ( 12.6b holds for 
(x',y') — (* 2 ,y 2 ) and t = t 2 . Similarly, we can obtain a Cauchy sequence {(x,,;y,)} with 
limit (x,y) and T; /* f such that ( 12.6b holds for (V,/) = (xi,yi) and T = T,-. 

Either f = 1 or f < 1. If f < 1, then it is elementary from the fact that {(xi,yi)} is 
Cauchy and gph(5) is locally closed, that ( 12.6b holds for {x' ,y') — (x,y) and T = f . This 
argument also tells us that we can find some (x 1 ,/) so that ( 12.61 ) is satisfied for T = T. With 
(x, y ) , we can proceed as before to find (x',y') satisfying ( 12.6b for T = 1. 

Step 2: Wrapping up 
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So far, we have shown that for all (x*,y*) G [U e x V £ ] ngph(S) andx° G U e , we can find 
(*',/) e [U x V] ngph(S) such that 

||*'-x || < {8 + e)\\x°-x*\\ 
and y*-y' e (H+8 + e)(x* -x°). 

Write (xj,^) = (x',y'), and p\ =x° — Jtj. Using a similar process as outlined in step 1 
and the fact that for we can find (p\ ,q\) G r gph ( $\ (x\ , y\ ) such that \\p-y — p[\\ < 5 1 \p\ || and 
q\ G — (H + 8)(— pi), we can find (x' 2 ,y' 2 ) G gph(S) such that 

< ( S + e)\\x°-x' 1 \\ 
and yi -y' 2 € (# + 5 + e) {x\ - x°) (2.7) 
c[||//|| + + 5 + e]||x°-x' 1 ||B. 

Note that ||jc°-j^|| < (e + 8)\\x° -x*\\. The condition ( I2.5bb was defined so that step 1 
can be applied here to find (x 2 ,y 2 ). Formula ( 12.71 ) implies 

II4-*°II<(S+ £ )V-**||, 

and y\-y' 2 c[\\H\\ + + 8 + e]\\x°~x\\\M 

c(e + S)[\\H\\ + + S + e]\\x°~x*\\B. 

Likewise, we can find (xj .yj) G gph(S) inductively such that 

||*;-*l<(5 + e)i|*°-*l, 



and y;_ 1 -y;c(5 + er 1 [||//|| + + 5 + £ ]||x 



-x 



The sequence {(^,yj)} i s Cauchy, and hence converges to a limit in the closed set gph(5) PI 
[U xV]. The x coordinate of this limit is x°. Let the y-coordinate of this limit be y°. Since 
< 8 + e < 1, we have 



y -y = y -yy 



1=1 



(H + 8 + e)(x*-x°) + [\\H\\ + + 8 + e} l 5 + £ 



This gives 

y* G y°+ [H + 8 + e + [\\H\\ + + 8 + e] 



l-8-e 



c S(x°) +(h + S + e + [\\H\\ + + 8 + e] i g g £ £ ^) 0* -*")• 

Since (x*,y*) is arbitrarily chosen in [C/ e x V e ] ngph(S) andx° is arbitrarily chosen in U £ , 
we are done. □ 

We now continue with the proof of Theorem l2.2r b). 

Proof. rTheorem I2.2f b)l Since S is locally closed at (x,y), we can always reduce the 
neighborhoods U and V if necessary so that [U x V] n gph(5) is closed. The condition 
DS(x\y)(p) f][—(H+ 8)(—p)} ^ easily implies the existence of (p 1 ,q') satisfying ( I2.41 i. 
(In fact, the vector p' in ( 12. 4t can be chosen to be /?.) Therefore the conditions in Lemma 
12.31 are satisfied. Since the e and 8 are in the statement of Lemma l2~3l are arbitrary, we 
have the pseudo strict //-differentiability of S as needed. □ 
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The proof of Theorem l2.2f c) follows with minor modifications from the methods in 1 8 1, 
who were in turn motivated by the proof of [2, Theorem 3.2.4] due to Frankowska. 

Proof. [Theorem I2.2l c)1 Condition (2') is identical to Condition (2) except for the use 
of the convexified graphical derivative D**S(x | y). We show that Conditions (2') and (2) 
are equivalent under the added conditions. It is clear that (2) =>■ (2'), so we only need to 
prove the opposite direction. Our proof is a slight amendment of Step 3 in the proof of |8] 
Theorem 1.2]. 

Suppose Condition (2') holds. Fix some 8 > 0. For any sets A,B C X xY, denote by 
d(A,b) :=inf{||a-6|| \ aeA,beB}. Let us fix (x,y) G gph(S) n [U x V] and p eX\{0}. 
Let w G -(H + S)(-p) and (p*,q*) G gph(D5(x | y)) be such that 

\\{p,w) - (pV)|| = d({p} x [-(H+8)(-p)],eph(DS(x | y))). 

Observe that the point (p*,q*) is the unique projection of any point in the open segment 
((p*,q*), (p,w)) on gph(DS(x | y)). We will prove that (p*,q*) — (p,w) and this will 
prove that w G DS(x \ y)(p) n [-(H + S)(-p)]. 

By the definition of the graphical derivative, there exists sequences t„ \ 0, p„ — > p* , 
q„ — > q* such that y + f,,^,, G S(x + t„p„) for all n. Let (x ni y n ) be a point in clgph(S) which 
is closest to (x,y) + -j(p* + p,q* + w) (a projection, not necessarily unique, of the latter 
point on the closure of gph(5)). Since (x,y) S gph(5) we have 



{x,y) + t -^(p* + P,q* + w)-(x n ,y n ) < ^\\{p*+p,q* 



and hence 



\\{x,y) - (x n ,y„)\\ < (x,y) + t ^{p* + p,q* + w) - (x n ,y n ) +j\\(p*+p,q* + w)\\ 

<t n \\(p*+p,q* + w)\\. 

Thus for n sufficiently large, we have (x n ,y n ) 6 U x V and hence (x n ,y n ) G gph(5) n [U X 
V]. Setting (p n ,q~n) = {x n ~ x ,yn —y)/t n , we deduce by the usual property of a projection 
that 



2 {P 



PA 



-w) - (p„,q„) G [T gph{s) (x n ,y n )}° = [gph(D**5(x„ | y n ))]° ■ 



By the assumptions in (2'), there exists w„ G D**S(x n \ y n ){p) H [—(H + S)(—p)] and we 
have from the above relation 



Pn,P 



q* + w 



We claim that (pn,qn) converges to (p*,q*) as n 
'p*+p q* + w 



-q n ,w„ 
Indeed 



<0. 



(2.8) 



1 



t„ 



1 

< — 

tn 



(x,y)+t„ 
(x,y)+t„ 

p*+p q* 



-(Pn,q n ) 
p q* + w 



2 ' 2 

P* + P 1* + w 
2 ' 2 

W \ 

-{Pn.qn) 



(x,y)-t„{p„,q n ] 
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Therefore, (p„,q„) is a bounded sequence and then, since y n = y + t„q n £ S(x n ) = S(x + 
t n pn), every cluster point (p,q) of it belongs to gph(DS(x | y)). Moreover, (p,q) satisfies 



p q 



(PA) 



< 



-p q 



The above inequality together with the fact that (p*,q*) is the unique closest point to 
j(p* +p,q* + w) in gph(D5(x | y)) implies that (p,q) = (p*,q*). Our claim is proved. 

Up to a subsequence, w„ satisfying ( 12.8b converges to some w e —(H + 8)(—p). Passing 
to the limit in (12.8b one obtains 



(p-p*,p} + (w-q*,w}<0. (2.9) 

Since (p,w) is the unique closest point of (p*,q*) to the closed convex set {p} x [—(// + 
8)(— p)], we have 

(w-q*,w-w)<0. (2.10) 

Finally, since (p*,q*) is the unique closest point to j(p* + p,q* +w) in gph(DS(x | y)) 
which is a closed cone, we get 

(p-p*,p*) + (w-q*,q*)=0. (2.11) 

In view of (T2~9l >, (l27TOb and (ISTTTb . we obtain 

\\(p,w)-(p*,q*)\\ 2 

= (w-q*,w-w) + ((p-p*,p} + (w-q*,w))-((p-p*,p*} + (w-q*,q*})<0. 

Hence p = p* and w — q*. We have DS(x \ y)(p) fl [— (H + 5)(p)] containing at least the 
element w, so it cannot be empty. Since 8 > 0, (x,y) G gph(5) n [t/ x V] and p € ^\{0} 
are arbitrary, we have Condition (2) in Theorem l2.2l as needed. □ 

As a corollary to Theorem l2.21 we obtain the Aubin criterion as proved in [8|. 

Theorem 2.4. (Aubin Criterion) Suppose Assumption \2.I\ holds. Let 



a := limsup ||DS(x | y)|| . 

gph(i) 

(a) We have lip5(x | y) < CC, and equality holds ifY is finite dimensional. 

(b) If both X and Y are finite dimensional, then 

lipS(jc|y)= limsup ||D**S(jc | y)||". 

(x, y )— — nm 

Proof. Recall that S has the Aubin property at (x,y) £ gph(S) if and only if it is pseudo 
strictly //-differentiable there for H defined by H(w) := Jc||w||B. For a given (x,y) £ 
gph(S), the smallest value of k > such that DS(x \ y){p) n K"||p||B ^ for all p ^ is 

||M(*|y)||- 

We apply these observations to Theorem l2.2l In (a), if a < °°, the condition lip 5 (jc | y) < 
a holds by Theorem l2.2r b). The statement is trivially true if a — °°. lflipS(x y) = °°, then 
lip ^(jc | y) < a from before gives a — «>. When Y is finite dimensional and lip Six | y) is 
finite, it follows from Theorem l2.2t a) that lip5 , (l \y) — a. For (b), the proof is similar. □ 

Theorem |2.4r b) was also proved with viability theory in (3]. 

We remark on the similarities between Lemma |2~3l and Aubin's original results. For a 
set-valued map S : X =^ Y, the inverse S- 1 : Y =4 X is defined by S" 1 (y) := {x \ y £ S(x)}, 
and satisfies gph(5 _1 ) = {(y,x) \ (x,y) £ gph(S)}. 



CHARACTERIZING GENERALIZED DERIVATIVES OF SET- VALUED MAPS 



11 



Remark 2.5. (Comparison to Aubin's original results) Let H : X Y be denned by H(w) := 
jc||vv||B. In [4, Theorem 7.5.4] and [6 1 Theorem 5.4.3], the necessary condition in both re- 
sults (up to some rephrasing) is that there are neighborhoods U of x and V of y such that 
for all p G X\{0} and (x,y) G gph(S) D [U X V], there exists q' and w such that 

pe[DS{x\y)]- l (q')+w, 4 G -H(-p) and ||w|| < 5||p||. 

Let p' = p — w. Then — < 5||p|| and (p',q r ) G 7gph(S) (^y); so the condition in ( 12.4b 
is satisfied. 

3. A SECOND CHARACTERIZATION: LIMITS OF GRAPHICAL DERIVATIVES 

While conditions (2) and (2') in Theorem 12.21 classify the generalized derivative, the 
presence of the term 8 may make these conditions difficult to check in practice. In Sub- 
section [32] we present another characterization on the generalized derivatives H . X 
that may be easier to check than Theorem 12.21 especially in the finite dimensional case. 
More specifically, consider {G,},e/, where G, ■: X =4 Y are positively homogeneous and / is 
some index set. We impose further conditions so that S is pseudo strictly //-differentiable 
at (x,y) if and only if 

Gi{p) n [-H{-p)\ ^ for all i G / and p G X\{0}. 

3.1. A generalized inner semicontinuity condition. Before we move on to the next 
subsection for a second characterization of generalized derivatives H : X =$ Y such that 
S : X =4 Y is pseudo strictly //-differentiable at (x,y), we propose a generalized notion of 
lower semicontinuity to simplify the results in Subsection l3.2l 

We say that S : W =4 R™ is a piecewise polyhedral map if gph(S) C W x W" is a 
piecewise polyhedral set, i.e., expressible as the union of finitely many polyhedral sets. 
The tangent cones on any two elements of a face of a polyhedron are the same, which 
leads us to the following result. 

Proposition 3.1. (Finitely many tangent cones for piecewise polyhedral maps) Suppose 
S : W W" is piecewise polyhedral. At any point (x,y) G gph(S), there is a neighborhood 
of{x,y) and a finite set {7;}, e / cl"x W such that Tgp b rs\(x,y) = Tj for some i G /. 

We next state a piecewise polyhedral example. 

Example 3.2. (Piecewise polyhedral S\ : R =4 K.) Consider the piecewise polyhedral set- 
valued map Si : R =4 R defined by 

S 1 (jc):=(-oo,-[x[]u[|*| > oo). (3.1) 

See Figure |4TI for a diagram of Si. The possibilities for T gph ^ Sl ^(x,y), where (x,y) G 
gph(Si) and (x,y) is close to (0,0) are gph(G,) for i £ {1, . . . ,6}, where G; : R =t R are 
defined by 

Gi(x) = [x,<x>) 
Gz(x) = (-°°,x] 

G 3 {x) = [-jc,oo) (3.2) 
G 4 (x) = (-°°,-x] 
Gs(x) = R 
G 6 (x) = Si(x). 



CHARACTERIZING GENERALIZED DERIVATIVES OF SET- VALUED MAPS 



12 



Notice that for the map Si defined in ( 13. U . while 7gph(S[) : gph(Si) =4 M. x R is not inner 
semicontinuous at (0,0), the possible limits for {7^ph(S 1 )( JC ;j)'j)}> where (xj,yj) — > (0,0), 
take on only a finite number of possibilities as stated in Proposition 13. II We now define a 
generalized inner semicontinuity that gets around this difficulty. 

Definition 3.3. (Generalized inner semicontinuity) Let {2}}^/ C Y, where / is some index 
set, and let C C X. For a closed-valued mapping S : C =$ Y and a point x G C C X, S is said 
to be {Ti\i e i-inner semicontinuous for {7]}, e /-wc) vw'f/i respect to C if for all p > and 
£ > 0, there exists a neighborhood V of x such that for all x € C (1 V, there is some i € / 
such that 7J n pB c S(jc) + el. 

In the case where |/| = 1 and T\ = S(x), {7]}, e /-inner semicontinuity reduces to the 
definition of inner semicontinuity. Going back to the map Si in ( 13. U . we note that the map 
T gph(Si) '■ SP h (Si) =SRxtis {gph(G,)}j 6 /-isc at (0,0), where the G, : R =4 R are defined 
in ( I3.21 i. The choice of {G,},^/ is not unique. We can instead define I — {1,2} and G; by 

Gi{x) —x and G2(x) = — x, (3.3) 

and T gph{Sl) : gph(Si) =t K x R will still be {gph(G,)}, G/ -isc at (0,0). Of course, the 
{gph(G,)}, G / defined in ( 13.3b are not possible limits of T gph / S \(x,y) as (x,y) > (0,0). 

gph(S, ) 

See Lemma [3~7l for a criteria in finite dimensions. 



The index set / need not be finite, as the following examples show. 

Example 3.4. (Infinite index set /) We give two examples where the index set / is neces- 
sarily infinite. 

(a) Consider the function f\ : M — > M defined by 

fo if x = 

/lW= 2 • ,i, s th ■ ^ 

\x sm(l/x) otherwise, 

which has Frechet derivative 

[0 ifx = 



2xsin(l jx) — cos(l jx) otherwise. 



The map : gph(/i) =} R x R is {gph(G A )} Ae[ _ u] -isc at (0,0), where G x : R -> R 

is the linear map with gradient A . 

(b) Next, consider the function fi : R 2 — > R defined by /a(jc) = H^lb- The map T gph ^ : 
gph(/ 2 ) ^R 2 x Ris [{gph(G A )}|| A || =1 ur gph(/2) (0,0)]-isc at (0,0), where G x : R 2 ^Ris 
the linear map with gradient X 6 R 2 . The map / 2 shows that the index set I in Definition 
can be infinite even when the function is single-valued and semi-algebraic. 



3.2. A second characterization of generalized derivatives. For Theorem l3.5l below. as- 
sume that the norm inX x Y is defined by ||(/>,#)||xxy := || (||p|k, ||^||f) \\ny where || • ||(2) 
is a norm in R 2 . 

Theorem 3.5. ( Characterization of generalized derivative ) Suppose Assumption \2. U holds. 
Let I be some index set, and G, : X =4 Y be positively homogeneous maps for all i G I. 
Consider the conditions 

(1) S is pseudo strictly H-differentiable at (x,y). 

(2) Gi{p) n {-H(-p)\ ^ 0/or all p G X\{0} and i G /. 

Then the following hold: 
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(a) Suppose Y is finite dimensional and H is compact-valued. If for all i € /, there 
exists {(xj,yj)} C gph(S) such that (xj,yj) — > (x,y) and 

limsup^gph(s) (xj,yj) C gph(Gj), 

then (1) implies (2). 

(b) Suppose \\H\\ + is finite, H is convex-valued, and the mapping T^ph(S) : gph(S) 
X xY is {gph(G,)} !6 /-isc at (x,y). Then (2) implies (1). 

Furthermore, ifX and Y are finite dimensional, and the mapping 7^ph(S) : gph(5) ^1x7 
was replaced by the mapping clco 7^ p h(s) : gph(5) ^4 X x Y to the closed convex hull of the 
tangent cone instead in (a) and (b), then the modified statements hold: 

(a') Suppose X and Y are finite dimensional, and H is compact-valued. If for all i € I, 
there exists {(xj, yj)} C gph(S) such that [xuyj) — > (x,y) and 

limsupclcor gph(s) (x 7 -,;y,) c gph(Gf), 

y-).oo 

then (1) implies (2). 

(W) Suppose X and Y are finite dimensional, and H is a prefan. If the mapping 
clcor gph ( 5 ) : gph(S) =3X xY is {gph(G,)} lG /-/.sc at (x,y), then (2) implies (1). 

Proof, (a) Suppose S is pseudo strictly //-differentiable at (x,y). For each G,-, there is a 
sequence {{xj,yj)}j C gph(S) converging to (x,y) such that limsupy^ T gph ^ (xj,yj) C 
gph(Gi). Furthermore, by Theorem l2.2f a). there is some 8j \ such that 

DS(xj\yj)(p)n[-(H+Sj)(-p)}^9>. 

Let qj be in the LHS of the above, and let q be a cluster point of {<7 ; }J =1 , which exists by 
the compactness of H(—p). Since gph(G,) D limsup^^ 7^(5) y 7 ), we have (p,q) G 
gph(G), and so G,-(p) n \-H(-p)] contains q. Hence G,-(p) n [-H (-/?)] ^ 0. 

(b) Given y > 0, we have neighborhoods U of i and V of j such that for all (x,y) £ 
[£/x V]ngph(S), we have 

gph(G,)nB XxF C [T gMs) (x,y)nM XxY } + YBxxY (3.5) 

for some i e 7, where Bxxy is the unit ball in X x Y. Let (x*,y*) £ gph(S) R [U X V], and 
let i* be such that (13.5b holds for (jc,y) = (x*,y*) and z = i*. Choose p e X\{0}. Since 
Gi*{p) n [-ff(-p)] ^ 0, choose g 6 Gj«(/j) n [-H(-p)]. Then e gph(G,»)- Since 

gph(G,*) is a cone, we may rescale (p,q) so that 11(^,^)11 = 1. From the fact that \\H\\ + is 
finite, and the equivalence of finite dimensional norms, there is some K > such that 

1 = \\(P,q)\\ 

< k{\\p\\ + \\q\\) 

< K(\\p\\ + \\H\\ + \\p\\) 

Recall that the choice of y in view of the generalized inner semicontinuity property gives 
us some (p',q') <E T gP h(s)( x * >y*) sucn tnat 

\\(p',q')-(p,q)\\<7- 

We have 

\\p-p'\\ <Y< + \\H\\ + )\\ P \\ and \\q-q'\\ < y < jcy(l + \\H\\ + )\\p\\. 
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The formula involving q implies that q' G — [H + Kj(l + \ \H\\ + )](—p). If 7 is chosen so that 
fcy(l + < 8, then the conditions in Lemma [2731 are satisfied, which easily implies 

that S is pseudo strictly H-differentiable at (x,y). 

(a') The proof for this statement carries through with minor changes from that of (a). 

(b') The proof for this statement requires added details from that of (b). Using the 
methods in the proof of (b), given 7 > 0, we have neighborhoods U of x and V of y such that 
for all (x*,y*) €[Ux V] ngph(S) and p G X\{0}, there exists (p',q') G clco7 gph(5) (x*,/) 
such that 

Ib-p'll <y<Kj{\ + \\H\\ + )\\p\\ and?' G -[H+KJ{\ + \\H\\ + )](- P ). 

The current proof now departs from that in (b). We first claim that we can reduce U 
and V if necessary so that \\D**S(x | y)||~ < (1 + \\H\\+) for all (x,y) G [U x V] ngph(S). 
Seeking a proof by contradiction to the claim, suppose there exists a sequence { (xj,yj)}j C 
gph(S) such that (xj,yj) -> (xj) and \\D**S(xj \ y } )\\- > (1 + \\H\\+) for all j. Then by 
|[T8l Theorem 4.18], {gph(D**S(xj \ yj))}J = i has a subsequence that converges in the 
set-valued sense to gph(G), where G : X =^ Y is positively homogeneous and ||G||~ > 
(1 + \\H\\ + ). We must then have G(p) n [-H(-p)] = for some p G X\{0}. By the 
generalized inner semicontinuity property, there is some i' G / such that G,/ C G, giving us 
Gj/(p) n [—H(—p)] = 0, which is a violation of the assumption in (2). 

From the claim we just proved, we have \\D**S(x* | y*)||~ < 1 + Note also that 

D**S(x* \ y*) is graphically convex and positively homogeneous. By the Aubin criterion in 
Theoreml2~4l D**S(x* \ y*) has the Aubin property with lipD**S(x* \ y*) < 1 + \\H\\ + . We 
have 

q> G D**S(x* \y*)(p') 

C D**S(x*\f)(p) + (l + \\H\\ + )\\p-p'\\M. 
This means that there exists q" such that 

k'WH < (1 + \\H\\ + )\\ P p'\\ < KJ{\ + ||//|| + ) 2 HpII, 

and / £D**S(x* \ y*)(p). So q" G -(H + Ky[2 + 3\\H\\ + + (\\H\\ + ) 2 ])(-p), which im- 
plies 

D**S(x* I y*)(p) n[-{H+ k Y [2 + 3\\H\\ + + (\\H\\+) 2 }) (-p)] ± 0. 
Since 7 > can be made arbitrarily small, (x* ,y*) is arbitrary in [U X V] fl gph(5) and p is 
arbitrary in X\{0}, we can apply Theorem l2.2r c) and prove what we need. □ 

We have the following simplification in the Clarke regular case. 

Corollary 3.6. ( Clarke regular, finite dimensional case) Suppose S : K" =t M m is locally 
closed and gph(S) is Clarke regular at (x,y) G gph(S). Let H :W =4 K'" be a prefan. Then 
S is pseudo strictly H-differentiable at (x,y) if and only if 

DS{x I y){p) n [-H{-p)] <dfor all p G K"\{0}. 

Proof. In finite dimensions, the Clarke regularity of gph(5) is defined by the inner semi- 
continuity of 7^ph(s) : gph(S) 4^x7. Apply Theorem |33J a) and (b) for / = {1} and 
Gi=DS{x\y). a 

An easy consequence of the Clarke regularity of gph(5) is that the positively homoge- 
neous map H : R" =t R m can be chosen to be single-valued. 

For our next result, we need to take a different view of the tangent cone mapping T aph ^ : 
gph(S) ^4 X xY. Denote the family of closed sets in X x Y to be ^(X x Y). We can 
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write the set-valued map T gph ^ S ) as 7L,h(s) : gph(S) — > ^(X x F), as is sometimes done in 
standard texts in set-valued analysis. If X and Y are finite dimensional, then it is known 
that ff(X x Y) is a metric space. We need to consider the outer limit of the map ^ gp h(s) : 
gph(S) =4 ^{X x Y), To avoid confusion, we will use capitals to denote the outer limit in 
the set-valued sense, that is 

l imsup y w (*,y) 

:= {C C X x F | 3{xj, yj ) — » s.t. ^(xy.yy) -> C}. 

gph(S) 

In general, for S : X =^ F, [18. Theorem 4.19] gives 

limsupSO) = U{C | C G LLMSUPS(x)}, (3.6a) 

and liminfS(x) = n{C | C £ LIMSUPS(x)}. (3.6b) 

x— >x x—>x 

We now compare the conditions in Theorem 13 .51 with what we can get from the outer 
limit LIMSUP. 

Lemma 3.7. (Finite dimensional LIMSUP) Suppose S : W =4 R m is closed-valued and 
{Q} ie i C C €{Y). Then 

(a) For all i G I, there exists {xk} C X such that Xk —> x and limsup^^ S(xi c ) C C; 
and only if for all i G 7, there exists some D £ LIMSUP^i S(x) such that D C C,-. 

(b) If for all D G LIMSUP.^.i S(x), there exists i G I such that Ci C D, then S is {C;} (G /- 
isc at x. 

Proof, (a) The forward direction follows immediately from the fact that for Xk — > x, we 
can find a subsequence if necessary so that limjt->oo5(jcjt) exists and converges to some 
D G LIMSUPjc-kj S{x) by ifTSl Theorem 4.18]. The reverse direction is straightforward. 

(b) We prove this by contradiction. Suppose that S is not {Q}, 6 /-isc at x. That is, there 
exists e > and p > and a sequence {xk}T = ^ such that Xk —> x and 

Q npB<£ S{x k ) + el for all i G L 

We may choose a subsequence of {jCfc}T = i if necessary so that limbec S(xk) exists. Fix 
i* G /. A straightforward application of [ 18 Theorem 4.10(a)] shows that 

Ci* <f_ liminfS^) = lim S(x\\. 

Since i* is arbitrary and lim ( t_ ! .oo5(x J t) G LPMSUPx^x^x), we have a contradiction, and 
our proof is complete. □ 

Theorem 3.8. (Finite dimensional classification of generalized derivatives) Let S : R" =4 
R m be such that S is locally closed at (x,y) G gph(S), and H : W =4 R™ be a prefan. Then 
S is pseudo strictly H-differentiable at (x,y) if and only if 

G(p)n[-H(-p)]^<D 

whenever p G R"\{0} and gph(G) G L IMSU P r gph(s) (x,y) . (3.7) 

{x ' y) g vh(s) Hx * h JJ ' 

The above continues to hold if the term a in ( 13.71 l is replaced by clco Tg^/m, the closed 
convex hull of the tangent cone. 

Proof. Let LIMSUP( X V ) >(xy)T gp h(s){ x ,y) = {gph(G,)} !G / and use Theorem 13.51 and 

gph(S) 

Lemma[3Jl The case of the closed convex hull is similar. □ 
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4. Examples 



We illustrate how the results in Subsection l3.2l can be used to characterize the general- 
ized derivatives H : X =4 Y in various cases. 

Example 4.1. (Characterizing generalized derivatives) We apply the results in Subsection 
13.21 to characterize the prefans H : X =4 Y that are the generalized derivatives in several 
functions defined earlier. 

(1) Consider the map S i : R =t R defined by S\ (x) = (-°°, -|*|] u [|*|,°°). See Figure 
|4~TI Let / = {1, ... ,6}, define G, : K z}l as in (O, and check that {Gi} ie i are 
such that {gph(G; equals LIMSUP T sph / Sl \(x,y). Hence the conditions 

(x,y) — >{0,0) 

in Theorem |3.8| are satisfied at (0,0). We observe that 
Gi (1) n [-H(-l)] ^ and G 3 (l) n [-H(-l)] ^ 

implies [-1,1] Cff(-l), 
and G 2 (-l) n [-tf(l)] ^ and G 4 (-l) n [-//(l)] ^0 

implies [-1,1] Cfl(l). 

So S\ is pseudo strictly //-differentiable at (0,0) if and only if [— \p\, \p\] C H(p) 
for all pel. 

Note that Gs(x) does not set any restriction on H. Observe that we only used 
G, for i = 1,2,3,4 in (I3.21 l. We can also apply Theorem 13.81 with the fact that 
{gph(G,)}, e n 51 equals LIMSUP clcor gph ( 5l ) (x,y) to see that G(, is not 

(x,y) — ; >(0,0) 

gph(Si) 

needed in characterizing the generalized derivative H. 

(2) Consider the map S 2 : K =4 K defined by 5 2 (x) := {jc} U {-x}. See Figuregl] Let 
/= {1,2,3}, and define G, : M M by 

Gi (x) = x 

G2(x) = -x 

G 3 (x) = S 2 (x). 

Then {G,} !G/ are such that {gph(G,)} !G/ equals LIMSUP (x , v ) ^ (0 , ) 7g P h(s 2 ) ( x '3'), 

gphW 

and hence satisfies the conditions in Theorem l3.8l at (0, 0). We can easily to check 
that Si is pseudo strictly //-differentiable at (0, 0) if and only if [ — 1,1] CH(p) for 
p = 1,-1, though the proof is slightly different from that in Si . 

(3) Consider the maps /] : K -)• E and / 2 : M 2 -> R in Example El With additional 
work, we get /, is pseudo strictly //-differentiable at (0,0) if and only if B C H(p) 
for all 1 1 p | = 1 for both i— 1,2. 

We remark on the assumption that H is convex-valued in many of the results in this 
paper. 

Remark 4.2. (Convex-valuedness of H) Consider the set-valued maps S\ : R =$ R and 
S 2 : R =4 R defined by 

Si(je):=(-oo,-|*|]u[|*|,oo) and S 2 (x) = {-x} U {x} . 
Also define S 3 : R =1 R by 

'{x}U{-x} ifx<0 

[— x.x] ifx>0. 



S 3 (x) 
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Figure 4.1. The maps S t : R =t R for i = 1,2, 3 are used in Remarkl4~2l 
and in Examples l3.2l and l4.ll 



Define the map H' : R =} R by = 5 2 . See Figuregj] Note that //' is not convex-valued, 
but satisfies all other requirements in Theorems 12.21 and !3.5l for both Si and S3. While Si 
is pseudo strictly //'-differentiable at (0,0), S3 is not pseudo strictly //'-differentiable at 
(0,0). 

5. A THIRD CHARACTERIZATION: GENERALIZING THE MORDUKHOVICH CRITERION 

For S : X =$ Y, the Mordukhovich criterion expresses lip5(x | y) in terms of the limiting 
normal cone. In this section, we make use of previous results to show how the limiting 
normal cone can give a characterization of the generalized derivative H : X =4 Y when 
X = R" and Y = M.'". We also show that the convexified coderivatives have a bijective 
relationship with the set of possible generalized derivatives. 

We start by defining the limiting normal cone. 

Definition 5.1. (Normal cones) For a set C C R", the regular normal cone at x is defined 

as 

N c (x) := {y I (y,x—x) < o(||jc — jc||) for all* E C. 

The limiting (or Mordukhovich) normal cone Nc{x) is defined as limsup^j^VcM, or as 

c ' 

Nc(x) = {y I there exists X[ — > x, y,- € Nc(xi) such that y; y}. 

In Lemma|52]and Theorem \5A\ below, let R + = [0,°°) so that for v ^ 0, M+{v} is the 
cone generated by v. We shall refer to positively homogeneous maps that have convex 
graphs as convex processes, as is commonly done in the literature. 

Lemma 5.2. (Polar cone criteria) Let G : W =4 R m be a convex process, and H :W 
«" be a prefan. For each (u,v) G [gph(G)]° C R" x R m , define G ( „, v) : W =4 R m by 
gph(G M ) = [R + {(u,v)}} Q . Then 

G[p) n [-H{-p)] j*= id for all p e R"\{0} 
if and only if G ( „, v) (p) n [-H(-p)} ± 0/or all p e R"\{0} and (u, v) G [gph(G)]°. 

Proof. It is clear that for each v G [gph(G)]°, the G C G v , so the forward direction is easy. 
We now prove the reverse direction by contradiction. 

Suppose G(p) n \—H(—p)\ — for some p^=0. This means that the convex sets gph(G) 
and {p} x \—H(—p)] do not intersect, so there exists some (5,v) G R" x R m and a G R 
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such that 

((w,v), (x,y)) < a for all (x,y) G gph(G) 
and ((w,v), (p,y)} > a for all y G [-H(—p)], 

Since (0,0) G gph(G), a must be positive. Furthermore, since gph(G) is a cone, we have 

((S,v),(.*,y)}<0forall (x,y) G gph(G) (5.1a) 
and ((u,v),{p,y)} >0 for ally e \-H(-p)]. (5.1b) 

Note that dSTTab implies that (u,v) G [gph(G)]°, and that G (a ^ : W =$ R'" is defined by 
G(a,v){p) := I ((">v), (p,y)) < 0}. By the definition of G(a,v) ar, d < I5. lbt . we have 
G(a,v) ip) H [— -ff (— /?)] = 0, which is what we need. □ 

We now recall the definition of coderivatives. 

Definition 5.3. (Coderivatives) For a set-valued map S : R n R m and (x,y) G gph(S), the 
regular coderivative at (.x,y), denoted by D*S(x \ y) : R'" =4 R™, is defined by 

v G £>*5(i | y)(w) (v, m) g N gph(s) (x,y) 

& ((v,-u),(x,y) - (x,y)) < o(\\(x,y) - (x,y)\\) 
for all (x,y) G gph(S). 

The limiting coderivative (or Mordukhovich coderivative) at (-f,y) G gph(S) is denoted by 
D*S(x | y) : W" =4 W and is defined by 

v G D*S(x | y)(u) ^ (y, -u) G A^ gph(s) (x,y). 

In the definitions of both the regular and limiting coderivatives, the minus sign before u 
is necessary so that if / : W — >■ R m is at x, then 

D*/(* I m)(y) = V/(jc)*y for all y G R m . 
We can now state the main result of this section. 

Theorem 5.4. f Generalized Mordukhovich criterion) Let S : R" R m fee locally closed at 
(x,y) G gph(S) and let H : R" =4 R m fee a prefan. Then S is pseudo strictly H-differentiable 
at (x,y) if and only if any of the following equivalent conditions hold: 

(a) For all p G R"\{0} and (u,v) G N gph ^\{x,y), there exists y G H(p) s.t. 
(v,y) > -(«,/?). 

(b) For a«/? gR"\{0} and mgR", min («,y) < min (v,p). 

yeH(p) veD*S{x\y)(u) 

(c) For all p G R"\{0} ant/ u G R m , min («,y) < min (v,p) . 

yeH(p) veclcoD* S(x\y){u) 

Proof To simplify notation, let {gph(G,)}ie/ = LMSUP^y) > ( if )Clcor gph(S )(x,y). 

gph(S) 

We also use the definition of G(„ v ) : R" =$ R m defined in the statement of Lemma l5T2l and 
the following equivalent formulations of (b) and (c): 

(b') For all p G W\{0} and v G D*S(x | y)(w), there exists y G H(p) s.t. (u,y) < (v,p) . 
(c') For all p G R"\{0} and v G clcoD*S(x \ y)(u), there exists y G H(p) s.t. (u,y) < 
(V,P). 
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Using [18, Corollary 11.35(b)] (which states that a closed convex cone converges if and 
only if its polar converges), we have 

LIMSUP ff tm (x,y)= LIMSUP [clcor gph(5) (x,y)]° 

(X,y) — - — >(xj) (x,y) — - — >{x,y) 

gph(5) gph(S) 

= {[gph(G ! )]°} ;e / 

By the observation in ( 13.6al >. which recalls lfl8l Proposition 4.19], we have 

N gph (s)(x,y) = limsup N gph ( S )(x,y) = (J[gph(G;)]°. 

gph(S') 

By Lemma |52] 

GO) n [-H(-p)} ^ for all p e R"\{0} 
if and only if G ( „ >v) (p) n [-H(-p)\ ^ for all p e R n \{0} and («,v) G [gph(G)]°. 
By Theorem l3.8l 5 is pseudo strictly //-differentiable at (x,y) if and only if 
Gi{p) n [-//(-/?)] ^ for all p G R"\{0} and / G /, 

or equivalently, G?(„ >v )(p) n [-ff(-p)] ^ for all p G R"\{0} and (m,v) G (J[gph(G;)]°. 

iei 

We can substitute Uie/fepM^;)] = N gph r^(x,y) in the above formula. Unrolling the def- 
inition of G( H)V ) gives: For all p G R"\{0} and (w,v) £ ^V gP h(s)(*jy)> there exists some 
y G [— //(— p)] such that ((w,v), (p,)0) < 0, which is easily seen to be condition (a). Con- 
dition (b') rephrases condition (a) in terms of the limiting coderivatives, while condition 
(c) is equivalent to condition (b) by elementary properties of convexity. □ 

Characterizing the generalized derivatives H : R" =$ W" in terms N gvh ^(x,y) or D*S(x | 
y) instead of the tangent cones not only enjoys a simpler statement, it also enables one 
to use tools for normal cones that may not be present for tangent cones. For example, 
estimates of the coderivatives of the composition of two set-valued maps are more easily 
available than corresponding results in terms of tangent cones. 

In the particular case of considering the Aubin property, we obtain the classical Mor- 
dukhovich criterion. 



Remark 5.5. (Mordukhovich criterion) Using Lemma 15721 and Theorem 15.41 if (u,v) G 
Ngph(s) (*> S) > the smallest k such that G( H)V ) (p) n K||p||B ^ for all p G R"\{0} is || u \\ / \\ v \\ . 
This gives 

HpS(x\y) = sup{||m||/||v|| | (m,v) eN gph{s) (x,y)} 

= \\D*S(x\y)\\ + 

= ||clcoD*5(x|y)|| + , 

which is precisely the conclusion of the Mordukhovich criterion in the finite dimensional 
case. 

Theorem l5~4l c) shows that c\co D*S(x \ y) characterizes all possible generalized deriva- 
tives H : R" =4 R'"- As Theorem l5.8l shows. the reverse holds as well. 

Lemma 5.6. ( Outer semicontinuity of convexified maps) Suppose D : R m =4 R" is osc, and 
is locally bounded at x. Then the map coD : R m =4 R", which maps x to the convex hull of 
D(x), is osc at x. 
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Proof. It suffices to show that if y; 6 co D(xi), yi — > y and xi — > x, then y E D(x). By 
Caratheodory's theorem, we can write yt as a convex combination of Zi,i, z^i, Zi. n +\- 
By taking a subsequence if necessary, we can assume that zi,\ converges to some zi in 
D{x). Doing this n + 1 times allows us to assume that for any j E { 1 , . . . , n + 1 }, {zij}^ 
converges to some zj E D(x). It is elementary that y is in the convex hull of {z\ , . . . , z n +\ }, 
which gives y G D(x) as needed. □ 

For D : R m =4 W such that D is positively homogeneous and \\D\\ + is finite, define 



Suppose S : W =4 K™ is locally closed at (x,y). By Theoreml5H {D*S{x \ y)) is the set 
of all possible H with the relevant properties such that S is pseudo strictly H-differentiable 
at (x,y). We now state another lemma. 

Lemma 5.7. ( Convexified coderivatives and generalized derivatives) Suppose Dj : R m 
K" such that Di is positively homogeneous, osc, and is finite for i = 1,2. 77;en the 

following hold. 

(1) clcoDi C clco£> 2 implies Jf(Di) D J4f(D 2 ). 

(2) clcoDi ^ clcoD 2 implies ,¥?{Di) ± Jf (D 2 ). 

(3) clcoD! C clcoZJ 2 implies ,^{Di) D jr(D 2 ). 

(4) ^(DO = (D 2 ) /mpZi'ej' clcoD! = clcoD 2 . 

Proof. Property (1) follows easily from the definitions, property (4) is equivalent to prop- 
erty (2), and property (3) follows easily from property (1) and (2). We thus concentrate on 
proving property (4). We shall assume throughout that D\ and D 2 are convex-valued to cut 
down on notation. Assume Jf(D\) — ,ffl(D2). By the classical Mordukhovich criterion 
(in Remark l53l ). we must have ||D 1 ||+= ||I>2|| + - 

Suppose on the contrary that D\ ^D%. There must be some u and v such that without 
loss of generality, v ^ D\ (u) but v G D 2 (u). Since D\ (u) is convex, there is some w ^ 
and aeM such that 



By the outer semicontinuity of D\, there is a neighborhood B £ (u) of u such that D\{u) C 
{v I (w, v) > a} for all m G B e (w). Let the variable > be such that 2sin(0/2) = e. 
We can assume that ||vi>[| = ||S|| = 1. Define H : W =4 K m to be 



whereL> || + +max(a,0)cos 0]. See Figure l5. ll for an illustration of H(w) when 

a 0. 

Clearly, H is convex-valued, compact-valued and positively homogeneous, and \\H\\ + 
is finite. Once the claim below is proved, we will establish the result at hand. 



J?(D) by 



{H : R" =4 M!" : H is a prefan, 

and for all p E K"\{0} and u E R m , 
min (u,y) < min (v,p)}. 

y€H{p) veclcoD(u) 



(w,v) < a 
and (w,v) > a for all v G 
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FIGURE 5.1. In the proof of TheoremES we prove that H : W =4 M m 
satisfies the conditions in Theorem 15 .41 c) for the map D\ : K™ =4 R". 
The figure shows the distinct features in the two dimensional subspace 
in IR m containing 0, u and u. The points y\,yi and V3 as marked will be 
used in the proof of case 2 of Theorem 15. 8 1 



Claim: The map H satisfies the conditions in Theorem[53|c') for D\ but not for Dj_. 

Since v £ Di(u), Theorem 15.41 c') says that we can find aye // (w) such that < 
(v,w). But this is not the case since for all y G H(w), we have = |[a + (v,w)] > 
(v,w). 

Next, we show that // satisfies the conditions in Theorem 15 A\ c') for D\. We need to 
check that for all p € R"\{0} and (u,v) G gph(Di), we can find aye H(p) such that 
( u ,y) < ( v >p)- Since D\ is positively homogeneous, we can check only (k,v) G gph(Di) 
such that = 1. We can further assume that = 1. By the classical Mordukhovich 
criterion, we see that p^w poses no problems. 

Let <9B := {u G K m | ||m|| = 1}. By our earlier discussion on the outer semicontinuity of 
D\ and the fact that || + is finite, we have 

pBxR"]ngph(Di) c([5inB 2sin( g /2) (s)] x [||Z)i|| + Bn{v | (*,v> > o}]) 

reducing the possible pairs (u,v) G gph(Di) that we need to check. 

Case 1: If («,v) G [5BnB 2sin( g /2) (M)] x [||Di||+Bn{v | (w,v) > a}], then we can find 
y&H(w) s.t. (u,y) < (v,w). 

The case when u~uis easy and will be covered later. Consider the u G [<9BnB 2sin ^ / 2 ) (")]\{"}- 
Figure 15.11 shows the two dimensional space in R" containing the points 0, u and u in 
the case when a > 0. The intersection of ff(w) is also illustrated. The condition that 
// G <9B nB 2sin /g / 2 )(w) implies that the angle 9 in Figure IBTTI is in the interval [0, 9]. The 
point y\ is formally defined as the point lying in the two dimensional subspace spanned by 
u and u, and satisfies (u,y\) = j[a + (v,w)] and \\yi\\ 2 — {u,y\) 2 — L 2 . By restricting the 
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maximum angle 9 if necessary when a < and using elementary geometry, we have 

(u,yi) < (u,yi) 

= i[a + {v,w)] 

< a 

< (v,w), 

which gives us what we need. 

Case 2: If (u,v) £ [dB\B 2s wg/ 2 ) (")] x \\Di || + B, then we canfindy £ H(w) s.t. (u,y) < 
(v,w). 

In this case, we need to show that for all (u, v) given, we can find y £ H(w) such that 
(u,y) < —\\D\ || + . The fact that — || + < (v,w) will give us what we need. We split this 
case into two subcases. 

Subcase 2a: a > 0. 

For the choice of yi, we have 

(w,yi) = — Lsin0 + acos0. 

We first consider 9 £ [9~,n/2]. The RHS of the above attains its maximum when 9 = 9. 
The condition L > -ij [||Z)] || + + acos 0] implies that («,y) < — ||£>i || + as needed. 

We now treat the case where 6 £ [7t/2, n\. The point y 2 is defined similarly as in y\, 
except that (S,y2) = \\D\ \\ + . We have 

(u,y>2) = -Lsin0 + ||Di|| + cos0. 

From Figure I5T1 we can see that the RHS of the above attains its maximum when 9 = n, 
which gives (u,y2) < — ||Di|| + as needed. 
Subcase 2b: a < 0. 

Repeat the arguments for when 9 £ [G,n/2], but replace all occurrences of yi by yj as 
marked in Figure I5TI (The point y3 satisfiest (u,)>i) = will lie in H(w).) The case when 
9 £ [u/2, 7C] is also similar. This concludes the proof of the claim, and establishes (4). □ 

With the above lemma, we state a theorem on the relationship between convexified 
coderivatives and the generalized derivatives. 

Theorem 5.8. ( Convexified coderivatives from generalized derivatives) Suppose S : R" 
W" is locally closed at (x,y) £ gph(S) and has the Aubin property there. Then the convexi- 
fied coderivative c\coD*S(x \ y) : R m ~t W is uniquely determined by the set of all prefans 
H :M" ~t R m such that S is pseudo strictly H-differentiable at (x,y). 

Proof. The map D*S(x | y) is osc, and by Lemma [5^6l so is clcoD*S(x \ y). Apply Lemma 
|5771' 4) to get the result. □ 

6. Application to constraint mappings 

We conclude this paper by illustrating how the results presented in this paper give 
stronger results to constraint mappings. One particular example is the set-valued map 
defined by mixed equalities and inequalities that is usually studied with the Mangasarian- 
Fromovitz constraint qualification. The relationship between the generalized differentia- 
bility of set-valued maps and optimization problems is clear from the example in dl.lt . 

In Proposition 16. 1 1 below, we shall only treat the case where D is Clarke regular and 
apply Corollarv l3.6| to illustrate the spirit of our results. While stronger conditions for the 
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case where D is not Clarke regular can be deduced from the characterizations in Sections 
[3]and|5j the extra calculations do not give additional insight. 

Proposition 6.1. (Constraint mappings, adapted from lfl8l Example 9.44]) Let S(x) = 
F(x) — D for smooth F : R" — > W n and a closed, Clarke regular set D C R m ; then S (u) 
consists of all x satisfying the constraint system F(x) — u £ D, with u as a parameter. 

Suppose H : R m =4 W is a prefan such that for all p £ R m \{0}, there exists q £ —H(—p) 
such that VF(x)q — p £ Tjj{F(x) — u). Then S~ l is pseudo strictly H-differentiable at (u,x). 

Proof. The set gph(S) is specified by Fq(x, u) £D with Fq(x, u) = F(x) — u. The mapping 
F : R" x R™ -> R m is smooth, and its Jacobian VF (x,u) = [VF(Jc), -/] has full rank m. 
Applying the rule in 1 18, Exercise 6.7], we see that 

N gpHs) (x,u) = {(v,~y)\y£N D (F(x)-u),v = VF(x) T y} 

= {(v,-y)\y£N D (F(x)-u),v = VF{x) T y} 

= N g?h{s) (x,u). 

Therefore, gph(S) is Clarke regular at (x, u). From |[T8l Exercise 6.7] again, we see that 
W) = i(9,P) £R"x M m | VF(x)q - p £T D (F(x) -u)}, 
so T^-i) = {(p,q) £ R m x R" | VF(x)q-p£ T D (F(x)-u)}. 
The formula for T gph ^ s -iy together with Corollary 13. 61 gives the conclusion needed. □ 
If the constraint qualification 

y £ N D (F(x) -u),VF(x) T y = implies y = (6.1) 

holds in Proposition 16. 11 then [18, Exercise 9.44] states that S~ l has the Aubin property 
with modulus 

1 

y&r D P®-*) \\VF(x) T y 
IWI=i 

so an H : R m =^ R" satisfying the stated conditions can be found. 
The case where D = {0} r x R m ~ r in Proposition ^. 1 1 gives 

S^ 1 (u) := {x : Fi(x) = ui for i = 1, . . . ,r and Fi(x) < u\ for i = r+ 1, . . . ,m}. 

In this case, the constraint qualification (16. U is equivalent to the Mangasarian-Fromovitz 
constraint qualification defined by the existence of w £ R" satisfying 

VF { (x)w < Oforall jG{r+l,...,m}s.t. F,-(Jc)=0, 
and VF { (x)w = for all i £ {1, . . . ,r}. 

The corresponding conclusion in Proposition 16 . 1 1 can be easily deduced. 

Finally, we remark that the Aubin property of the constraint mapping S : R m =4 R" at 
(ii,x) is also equivalently studied as the metric regularity of S : W ^ R" 1 at (x, u). One may 
refer to standard references ifTJl [TBI [T8l for more on metric regularity and its relationship 
with the Aubin property. The equivalence between pseudo strict H-differentiability and 
generalized metric regularity is discussed in [17, Section 7]. 
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